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Abstract 

We give a new, simplified and detailed account of the correspondence 
between levels of the Sherali-Adams relaxation of graph isomorphism 
and levels of pebble-game equivalence with counting (higher-dimensional 
Wcisfeiler-Lehman colour refinement). The correspondence between basic 
colour refinement and fractional isomorphism, due to Ramana, Scheiner- 
man and Ullman |15j , is re- interpreted as the base level of Sherali-Adams 
and generalised to higher levels in this sense by Atserias and Maneva [T], 
who prove that the two resulting hierarchies interleave. In carrying this 
analysis further, we here give (a) a precise characterisation of the level k 
Sherali-Adams relaxation in terms of a modified counting pebble game; 
(b) a variant of the Sherali-Adams levels that precisely match the fc-pebble 
counting game; (c) a proof that the interleaving between these two hier- 
archies is strict. We also investigate the variation based on boolean arith- 
metic instead of real/rational arithmetic and obtain analogous correspon- 
dences and separations for plain fc-pebble equivalence (without counting). 
Our results are driven by considerably simplified accounts of the underly- 
ing combinatorics and linear algebra. 
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1 Introduction 

We study a surprising connection between equivalence in finite variable logics 
and a linear programming approach to the graph isomorphism problem. This 
connection has recently been uncovered by Atserias and Maneva [I], building 
on earlier work of Ramana, Scheinerman and Ullman [15] that just concerns 
the 2-variable case. 

Finite variable logics play a central role in finite model theory. Most im- 
portant for this paper are finite variable logics with counting, which have been 
specifically studied in connection with the question for a logical characterisa- 
tion of polynomial time and in connection with the graph isomorphism prob- 
lem (e.g. [5j QTJ [T2J Ej). Equivalence in finite variable logics can be 
characterised in terms of simple combinatorial games known as pebble games. 
Specifically, C fc -equivalence can be characterised by the bijective fc-pebble game 
introduced by Hella [9]. Cai, Fiirer and Immerman [5] observed that (In- 
equivalence exactly corresponds to indistinguishability by the /c-dimensional 
Weisfeiler-Lehman (WL) algorithm^] a combinatorial graph isomorphism algo- 
rithm introduced by Babai, who attributed it to work of Weisfeiler and Lehman 
in the 1970s. The 2-dimensional version of the WL algorithm precisely corre- 
sponds to an even simpler isomorphism algorithm known as colour refinement. 

The isomorphisms between two graphs can be described by the integral 
solutions of a system of linear equations. If we have two graphs with adja- 
cency matrices A and B, then each isomorphism from the first to the second 
corresponds to a permutation matrix X such that X 1 AX = B, or equivalently 



If we view the entries of X as variables, this equation corresponds to a system 
of linear equations. We can add inequalities that force X to be a permutation 
matrix and obtain a system ISO of linear equations and inequalities whose 
integral solutions correspond to the isomorphisms between the two graphs. In 
particular, the system ISO has an integral solution if any only if the two graphs 
are isomorphic. 

What happens if we drop the integrality constraints, that is, we admit ar- 
bitrary real solutions of the system ISO? We can ask for doubly stochastic 
matrices X satisfying equation (prj). (A real matrix is doubly stochastic if its 
entries are non-negative and all row sums and column sums are one.) Ramana, 
Scheinerman and Ullman [15] proved a beautiful result that establishes a con- 
nection between linear algebra and logic: the system ISO has a real solution 
if, and only if, the colour refinement algorithm does not distinguish the two 

1 The dimensions of the WL algorithm are counted differently in the literature; what we 
call "fc-dimensional" here is sometimes called "(fc — l)-dimensional" . 



AX = XB. 



(1) 
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graphs with adjacency matrices A and B. Recall that the latter is equivalent 
to the two graphs being C 2 -equivalent. 

To bridge the gap between integer linear programs and their LP-relaxations, 
researchers in combinatorial optimisation often add additional constraints to the 
linear programs to bring them closer to their integer counterparts. The Sherali- 
Adams hierarchy [19] of relaxations gives a systematic way of doing this. For 
every integer linear program IL in n variables and every positive integer k, 
there is a rank-k Sherali-Adams relaxation IL(/c) of IL, such that IL(1) is the 
standard LP-relaxation of IL where all integrality constraints are dropped and 
IL(ra) is equivalent to IL. There is a considerable body of research studying 
the strength of the various levels of this and related hierarchies (e.g. [3l [U [6l 

El USE]). 

Quite surprisingly, Atserias and Maneva [1] were able to lift the Ramana- 
Scheinerman-Ullman result, which we may now restate as an equivalence be- 
tween ISO(l) and C 2 -equivalence, to a close correspondence between the higher 
levels of the Sherali-Adams hierarchy for ISO and the logics C k . They proved 
for every k > 2: 

1. if ISO(/c) has a (real) solution, then the two graphs are C fc -equivalent; 

2. if the two graphs are C fc -equivalent, then ISO(fc — 1) has a solution. 

Atserias and Maneva used this results to transfer results about the logics C k 
to the world of polyhedral combinatorics and combinatorial optimisation, and 
conversely, results about the Sherali-Adams hierarchy to logic. 

Atserias and Maneva [I] left open the question whether the interleaving 
between the levels of the Sherali-Adams hierarchy and the finite-variable-logic 
hierarchy is strict or whether either the correspondence between (^-equivalence 
and ISO(fe) or the correspondence between C fc -equivalence and ISO(fc — 1) is 
exact. Note that for k = 2 the correspondence between C fc -equivalence and 
ISO(fc — 1) is exact by the Ramana-Scheinerman-Ullman theorem. We prove 
that for all k > 3 the interleaving is strict. However, we can prove an exact 
correspondence between ISO(/c — 1) and a variant of the bijective fc-pebble 
game that characterises C fc -equivalence. This variant, which we call the weak 
bijective /c-pebble game, is actually equivalent to a game called (k — l)-sliding 
game by Atserias and Maneva. 

Maybe most importantly, we prove that a natural combination of equali- 
ties from ISO(fc) and ISO(/c — 1) gives a linear program ISO(/c — 1/2) that 
characterises C fc -equivalence exactly. 

To obtain these results, we give simple new proofs of the theorems of Ra- 
mana, Scheinerman and Ullman and of Atserias and Maneva. Whereas the 
previous proofs use two non-trivial results from linear algebra, the Perron- 
Frobenius Theorem (about the eigenvalues of positive matrices) and the Birkhoff- 
von Neumann Theorem (stating that every doubly stochastic matrix is a convex 
combination of permutation matrices) , our proofs only use elementary linear al- 
gebra. This makes them more transparent and less mysterious (at least to us). 

In fact, the linear algebra we use is so simple that much of it can be carried 
out not only over the field of real numbers, but over arbitrary semirings. By 
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using similar algebraic arguments over the boolean semiring (with disjunction 
as addition and conjunction as multiplication), we obtain analogous results to 
those for C fc -equivalence for the ordinary A;- variable logic L fc , characterising In- 
equivalence, i.e., /c-pebble game equivalence without counting, by systems of 
'linear' equations over the boolean semiring. 

For the ease of presentation, we have decided to present our results only for 
undirected simple graphs. It is easy to extend all results to relational structures 
with at most binary relations. Atserias and Maneva did this for their results, 
and for ours the extension works analogously. An extension to structures with 
relations of higher arities also seems possible, but is more complicated and 
comes at the price of loosing some of the elegance of the results. 

2 Finite variable logics and pebble games 

We assume the reader is familiar with the basics of first-order logic FO. We 
almost exclusively consider first-order logic over finite graphs, which we view 
as finite relational structures with one binary relation, and in a few places over 
other finite relational structures. We assume graphs to be undirected and loop- 
free. For every positive integer k, we let L k be the fragment of FO consisting of 
all formulae that contain at most k distinct variables. 

We write A =f B to denote that two structures A, B are L k -equivalent, that 
is, satisfy the same L fc -sentences. L fc -equivalence can be characterised in terms 
of the k-pebble game, played by two players on a pair A, B of structures. A 
play of the game consists of a (possibly infinite) sequence of rounds. In each 
round, player I picks up one of his pebbles and places it on an element of one of 
the structures A, B. Player II answers by picking up her pebble with the same 
label and placing it on an element of the other structure. 

Note that after each round r there is a subset p C A x B consisting of the 
at most k pairs of elements on which the pairs of corresponding pebbles are 
placed. We call p the position after round r. Player I wins the play if every 
position that occurs is a local isomorphism, that is, a local mapping from A 
to B that is injective and preserves membership and non-membership in all 
relations (adjacency and non-adjacecny if A and B are graphs). 

Theorem 2.1 (Barwise [2], Immerman |10j). A =f B if, and only if, player II 
has a winning strategy for the k-pebble game on A, B. 

We extend L fc -equivalence to structures with distinguished elements. For 
tuples a and b of the same length (. < k we let A, a = k B, b if A, a and B, b 
satisfy the same L fc -formulae ^(x) with £ free variables x. The pebble game 
characterisation extends: A, a = k B, b if, and only if, player II has a winning 
strategy for the /c-pebble game on A, B starting with pebbles on a and the 
corresponding pebbles on b. The L k -type of a tuple a in a structure A is the 
=L-equivalence class of A, a. More syntactically, we may also view the L fc -type 
of a as the set of all L fc -formulae y(x) satisfied by A, a. 

Let us turn to the A;-variable counting logics. It is convenient to start with 
the (syntactical) extension C of FO by counting quantifiers 3- n . The semantics 
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of these counting quantifiers is the obvious one: 3- n x ip means that there are 
at least n elements x such that ip is satisfied. Of course this can be expressed 
in FO, but only by a formula that uses at least n variables. For all positive 
integers k, we let C k denote the /c-variable fragment of C. Whereas C and FO 
have the same expressive power, C k is strictly more expressive than L k . 

We write A =q B to indicate that structures A and B are C fc -equivalent. (in- 
equivalence can be characterised in terms of the bijective k-pebble game, which, 
like the fc-pebble game, is played by two players by placing k pairs of pebbles 
on a pair of structures A, B. The rounds of the bijective game are as follows. 
Player I picks up one of his pebble, and player II picks up her corresponding 
pebble. Then player II chooses a bijection / between A and B (if no such 
bijection exists, that is, if the structures have different cardinalities, player II 
immediately looses). Then player I places his pebble on an element a of A, and 
player II places her pebble on f(a). Again, player II wins a play if all positions 
are local isomorphisms. 

Theorem 2.2 (Hella [9]). A B if, and only if, player II has a winning 
strategy for the bijective k-pebble game on A, B. 

As L fc -equivalence, we extend C fc -equivalence to structures with distinguished 
elements, writing A, a B, b. Again, the pebble-game characterisation of the 
equivalence extends. We define C fc -types analogously to L fc -types. 

The colour refinement algorithm is a simple combinatorial heuristics for 
testing whether two graphs are isomorphic: Given two graphs A and B, which 
we assume to be disjoint, it computes a colouring of their vertices by the fol- 
lowing iterative procedure: Initially, all vertices have the same colour. Then 
in each round, the colouring is refined by assigning different colours to vertices 
that have a different number of neighbours of at least one colour assigned in the 
previous round. Thus after the first round, two vertices have the same colour 
if, and only if, they have the same degree. After the second round, two vertices 
have the same colour if, and only if, they have the same degree and for each d 
the same number of neighbours of degree d. The algorithm stops if no further 
refinement is achieved; this happens after at most \A\ + \B\ rounds. We call the 
resulting colouring of A Li B the stable colouring of A, B. If the stable colouring 
differs on the two graphs, that is, for some colour c the graphs have a different 
number of vertices of colour c, then we say that colour refinement distinguishes 
the graphs. 

Theorem 2.3 (Immerman and Lander [H]). A =J~ B if, any only if, colour 
refinement does not distinguish A and B. 

The k-dimensional Weisfeiler- Lehman algorithm (for short: k-WL) is a gen- 
eralisation of the colour refinement algorithm, which instead of vertices colours 
fe-tuples of vertices. Given two structures A and B, which we assume to be 
disjoint, fc-WL iteratively computes a colouring of A k LlB h . Initially, two tuples 
a = (oi, . . . , afc), b = (pi, . . . ,bfs) € A k Li B k get the same colour if the mapping 
defined by p(ai) = bi is a local isomorphism. In each round of the algorithm, 
the colouring is refined by assigning different colours to tuples that for some 
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j € [k] and some colour c have different numbers of j'-neighbours of colour c 
in their respective graphs. Here we call two fc-tuples j -neighbours if they differ 
only in their jth component. The algorithm stops if no further refinement is 
achieved; this happens after at most \A\ k + \B\ k rounds. If after the refinement 
process the colourings of the two graphs differ, that is, for some colour c the 
graphs have a different number of fc-tuples of colour c, then we say that fc-WL 
distinguishes the graphs. 

Theorem 2.4 (Cai, Fiirer, and Immerman [5]). A =q B if, and only if, k-WL 
does not distinguish A and B. 

More significantly, Cai, Fiirer, and Immerman [5] proved that for all k there 
are nonisomorphic graphs Ak , Bt of size 0{k) such that A = k c B. 

Note that the previous two theorems imply that colour refinement and 2-WL 
distinguish the same graphs. 

There are also 'boolean' versions of the two algorithms characterising In- 
equivalence (see [14]). 

3 Basic combinatorics and linear algebra 

We consider matrices with entries in B = {0, 1}, Q or M. A matrix X € R m,n 
with m rows and n columns has entry Xij in row i £ [m] = {1, . . . , m} and 
column j £ [n] = {1, . . . ,n}. We write E n for the ra-dimensional unit matrix. 

We write X ^ to say that (the real or rational) matrix X has only non- 
negative entries, and X > to say that all entries are strictly positive. We also 
speak of non-negative or strictly positive matrices in this sense. For a boolean 
matrix, strict positivity, X > means that all entries are 1. 

A square n x n-matrix is doubly stochastic if its entries are non-negative and 
if the sum of entries across every row and column is 1. Permutation matrices 
are doubly stochastic matrices over {0, 1}, with precisely one 1 in every row and 
in every column. Permutation matrices are orthogonal, i.e., PP l = P t P = E n 
for every permutation matrix P. The permutation p S S n associated with a 
permutation matrix P € M n,n is such that Pej = e p ^, i.e., it describes the 
permutation of the standard basis vectors that is effected by P. We also say 
that P represents p. The permutation matrices form a subgroup of the general 
linear groups. The doubly stochastic matrices do not form a subgroup, but are 
closed under transpose and product. 

It will be useful to have the shorthand notation 

Xd\D<2 = 

for the assertion that X^d^ = for all d\ £ D±, c?2 € D<i- If p and q are 
permutations in S n represented by permutation matrices P and Q, then 

{P t XQ) DlD2 =0 iff -X"p(Di) g (D 2 ) = 0- 

So, if IfljDj = and P and Q are chosen such that p~ 1 {D\) and q~ 1 (D2) are 
final and initial segments of [n], respectively, then P l XQ has a null block of 
dimensions x |Z?2| in the upper right-hand corner. 
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3.1 Decomposition into irreducible blocks 

Definition 3.1. With X € M n,n associate the directed graph 

G(X) :=H{(i,i):J^0}). 

The strongly connected components of G(X) induce a partition of the set [n] = 
{1, . . . ,n} of rows/columns of X. X is called irreducible if this partition has 
just the set [n] itself. 

Note that X is irreducible iff P l XP is irreducible for every permutation 
matrix P. 

Observation 3.2. Let X 6 R n,n ^ with strictly positive diagonal entries. 
If X is irreducible, then all powers X for £ n — 1 have non-zero entries 
throughout. Moreover, if X is irreducible, then so is X for all £ ^ 1. 

Proof. It is easily proved by induction on I ^ 1 that (X e )ij ^ if, and only if 
there is a directed path of length I from vertex i to vertex j in G(X). For X 
with positive diagonal entries, G(X) has loops in every vertex, and therefore 
there is a path of length £ from vertex i to vertex j if, and only if, there is path 
of length M' for every £' ^ £ from i to j. If G(X) is also strongly connected, 
then any two vertices are linked by a path of length up to n — 1. □ 

Let us call two matrices Z, Z' £ ]R ra ' n permutation-similar or S n -similar, 
Z ~5 n Z', if Z' = P l ZP for some permutation matrix P, i.e., if one is obtained 
from the other by a coherent permutation of rows and columns. 

Lemma 3.3. Every symmetric Z G R n,n ^ is permutation- similar to some 
block diagonal matrix diag(Zi , . . . , Z s ) with irreducible blocks Zi € W li ' ni . 

The permutation matrix P corresponding to the row- and column-permutation 
p G S n that puts Z into block diagonal form P t ZP = diag(Zi, . . . , Z s ) with ir- 
reducible blocks, is unique up to an outer permutation that re-arranges the block 
intervals ([ki + 1, hi + ^i])isgisg s where k{ = ^j<i n j; an( ^ a P r °duct of inner 
permutations within each one of these s blocks. 

The underlying partition [n] = Ui^i^^i, where Di := p([ki + 1, ki + ni\) for 
ki = Ylj<i n j> i s uniquely determined by Zlfl 

In the following we refer to the partition induced by a symmetric matrix Z. 

Proof. Obvious, based on the partition of the vertex set [n] of G(Z) into con- 
nected components (note that symmetry of Z is preserved under similarity, and 
strong connectivity is plain connectivity in G(Z) for symmetric Z). □ 

Observation 3.4. In the situation of Lemma \3.3\, the partition [n] = IJ-j^i 
induced by the symmetric matrix Z is the partition of [n] into the vertex sets 
of the connected components of G(Z). Then, for every pair i ^ j, Z £).£>. = 0, 
while all the minors Zj^^i ar ^ irreducible^ 

2 Here we regard two partitions as identical if they have the same partition sets, i.e., we 
ignore their indexing/enumeration. 

3 Note that this does not depend on the enumeration of the partition set Di, because 
irreducibility is invariant under permutation-similarity. 
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//, moreover, Z has strictly positive diagonal entries, then the partition in- 
duced by Z is the same as that induced by Z , for any (. ^ 1; for £ > n — 1, the 
diagonal blocks (Z e )r> i D i have non-zero entries throughout: {Z^)z) i D i > . 

The last assertion says that for a symmetric n x n matrix Z with non- 
negative entries and no zeroes on the diagonal, all powers Z for i ^ n — 1 are 
good symmetric in the sense of the following definition. 

Definition 3.5. Let Z ^ be symmetric with strictly positive diagonal. Then 
Z is called good symmetric if w.r.t. the partition [n] = IJj-Dj induced by Z, all 
Z DiDi > 0. 

More generally, a not necessarily symmetric matrix X ^ without null rows 
or columns is good if Z = XX 1 and Z' = X l X are good in the above sense. 

The importance of this notion lies in the fact that, as observed above, for 
an arbitrary symmetric n x n matrix Z ^ without zeroes on the diagonal, 
the partition induced by Z is the same as that induced by the good symmetric 
matrix Z := Z n ~ l ; and, as for any good matrix, this partition can simply be 
read off from Z: i,j G [n] are in the same partition set if, and only if, Zij ^ 0. 

Definition 3.6. Consider partitions [n] = [J i&I Di and [m] = Uie/-^ °^ the 
sets [n] and [m] with the same number of partition sets. We say that these two 
partitions are X-related for some matrix X € M n ' m if 

(i) X ^ has no null rows or columns, and 

(ii) X^d' = for every pair of distinct indices i,j G /. 

Note that partitions that are X-related are X'-related in the opposite di- 
rection. More importantly, each one of the X/X*-related partitions can be 
recovered from the other one through X according to 

D\ = {d' £ [m] : X dd i > for some d € A}, 
Di = {d £ [n] : X dd i > for some d' E D[}. 

For a more algebraic treatment, we associate with the partition sets Di of 
a partition [n] = [J ieI Di the characteristic vectors dj with entries 1 and 
according to whether the corresponding component belongs to Di: 

where e^ is the d-th. standard basis vector. In terms of these characteristic 
vectors dj for [n] = \J i£l Di and d' { for [m] = (J iG/ Z)., the X/X*-relatedness of 
these partitions means that 

D[ = K E[m): (X*<L> > 0}, 
Di = {dG[n):(Xd' i ) d >0}. 

Lemma 3.7. // two partitions [n] = \J iG ^Di an d VA = Uie/-^ °f ^he same set 
[n] are X-related for some doubly stochastic matrix X € R n,n , then \Di\ = \D'j\ 
for all i € /, and for the characteristic vectors dj and d' t of the partition sets 
Di and D[ even 

di = Xd[ and d[ = X*d t . 
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Proof. Observe that for all d £ [n] we have < (Xd'^d = J2d'eD' X dd' < 1- It 
follows immediately from the definition of X-relatedness that (Xd'^d = for 
all d Di. Therefore, 

iai > Y, ( xd ^ d = E (* d ^ = E E x ^ = \ D 'i\- 

d&Di de[n] d'eD^dsln] 

Similarly, < (X'cLj^ < 1 for d' £ [n], and |Z><| > Ed'eD'P^V = |A|- 
Together, we obtain 

iai = x;w)«i = i^i= E( x4d ^'- 

As all summands are bounded by 1, this implies (Xd'^d = 1 for all d £ A 
and pf*di) d / = 1 for all d' £ A- □ 

Lemma 3.8. Let X ^ be an mxn matrix without null rows or columns. Then 
the mxm matrix Z := XX 1 and the nxn matrix Z' := X l X are symmetric 
with positive entries on their diagonals. Moreover, the (unique) partitions of 
[m] and [n] that are induced by Z and Z' , respectively, are X / X t -related^ 

Proof. It is obvious that Z and Z' are symmetric with positive diagonal entries. 
Let partitions [m] = |J ig jA ano - M = Uiei'-^'i ' 3e obtained from decomposi- 
tions of Z and Z' into irreducible blocks. We need to show that the non-zero 
entries in X give rise to a coherent bijection between the index sets I and I' 
of the two partitions, in the sense that partition sets A and D'- are related if, 
and only if, some pair of members d £ A an d d! £ D'- have a positive entry 
Xdd 1 ■ Then a re-numbering of one of these partitions will make them X-related 
in the sense of Definition 13.61 Recall from Observation 13.41 that the A are the 
vertex sets of the connected components of G(XX t ) on [m], while the D[ the 
are the vertex sets of the connected components of G(X t X) on [n]. 

Consider the uniformly directed bipartite graph G(X) on [m] U [n] with an 
edge from i £ [m] to j £ [n] if Xij > 0. In light of the symmetry of the whole 
situation w.r.t. X and X t : , it just remains to argue for instance that no i £ [m] 
can have edges into two distinct sets of the partition [n] = [_J ie// A'- But any two 
target nodes of edges from one and the same i £ [n] are in the same connected 
component of G(X t X), hence in the same partition set. □ 

In the situation of Lemma 13.81 powers of Z induce the same partitions as 
Z, and the partitions induced by (Z X)(Z Xf = Z 2e+1 are X/X*-related as 
well as Z^X/X*Z £ -related, for all O 1- 

For £ ^ n/2 — 1, the matrix Z e X has no null rows or columns: else 
Z^X^Z^Xy = Z 2i+1 would have to have a zero entry on the diagonal, con- 
tradicting the fact that this symmetric matrix is good symmetric in the sense 
of Definition [33J The same reasoning shows that Z e X is itself good in the sense 
of Definition 13.51 

4 As X/X'-relatedness refers to partitions presented with an indexing of the partition sets, 
we need to allow a suitable re-indexing for at least one of them, so as to match the other one. 
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Corollary 3.9. Let X ^ be an mxn matrix without null rows or columns, 
Z = XX t , Z' = X l X the associated symmetric matrices with non-zero entries 
on the diagonal. Then for £ ^ m — 1, the matrix X := Z^X = X(Z'Y and its 
transpose X 1 = X t Z i = (Z'YX 1 are good and relate the partitions [m] = Uj-Dj 
and [n] = ijj-C^ induced by Z and Z' , respectively^ Moreover, 

(i) Xfj i £)i > for all i, and 

(ii) X DiD>. = for alii ^ j. 

Proof. Z^X is good symmetric by the above reasoning. So (Z e ) DiDi > for all i, 
while {Z m ) DiDj = for all j + i. It follows that (Z e X) DiD , = \z e ) DiDz X DtD , 
has only non-zero entries because In.ni does not have null columns. This 
proves (i). Assertion (ii) is clear as, for i ^ j, (Z e X) DiD > = (Z e )f) i £) j X D D > = 

ox D D ,=o. 3 3 □ 

Aside: boolean vs. real arithmetic 

Looking at matrices with {0, l}-entries, we may not only treat them as matrices 
over M as we have done so far, but also over other fields, or as matrices over the 
boolean semiring B = {0, 1} with the logical operations of V for addition and A 
for multiplication. Though not even forming a ring, boolean arithmetic yields 
a very natural interpretation in the context where we associate non-negative 
entries with edges, as we did in passage from X to G{X) (cf. Definition 13.11 and 
Observation 13. 2\\ . The 'normalisation map' x : ~~ ► {0, 1}, x i— > 1 iff x > 0, 
relates the arithmetic of reals x, y ^ to boolean arithmetic in 

X{x + y) = x(x) Vx(y) and x{xy) = x{%) A x(y)- 

This is the 'logical' arithmetic that supports, for instance, arguments used 
in Observation 13.21 for any real nxn matrix X ^ 0, (XX) ij = X^X^j ^ 
iff there is at least one k € [n] for which X^ ^ and X^j ^ iff Vfc<=[ n ] W^Qfc) A 
x(Xkj)) = 1. It is no surprise, therefore, that several of the considerations ap- 
parently presented for real non-negative matrices above, have immediate ana- 
logues for boolean arithmetic - in fact, one could argue, that the boolean in- 
terpretation is closer to the combinatorial essence. We briefly sum up these 
analogues with a view to their use in the analysis of L fc -equivalence, while the 
real versions are related to C fc -equivalence. Note also that the boolean analogue 
of a doubly stochastic matrix with non-negative real entries is a matrix without 
null rows or columns. 

Also note that Definitions 13.11 (irreducibility) and 13.61 (X-relatedness) are 
applicable to boolean matrices without any changes. Observations I5~2l and [3741 
go through (as just indicated), and so does Lemma [3731 For Lemma [3771 one 
may look at X-related partitions of sets [m] and [n], where not necessarily 
n = m, by any boolean matrix X without null rows or columns and obtains the 
relationship between the characteristic vectors as stated there, now in terms 
of boolean arithmetic - but of course we do not get any numerical equalities 
between the sizes of the partition sets. Lemma 13.81 finally, applies to boolean 
arithmetic, exactly as stated. 
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Lemma 3.10. In the sense of boolean arithmetic for matrices with entries in 
1 = {0,1}: 

(a) Any symmetric Z G M n ' n induces a unique partition of [n] for which the 
diagonal minors induced by the partition sets are irreducible and the re- 
maining blocks null; d, d' G [n] are in the same partition set if, and only 
if, in the sense of boolean arithmetic [Z ■ )dd' = 1 f or any/all I n — 1. 

(b) If two partitions (not necessarily of the same set) with the same number 
of partition sets are related by some boolean matrix X G M m ' n , then the 
characteristic vectors (dj)jgj and (d-)j g / of the partitions are related by 
dj = Xd[ and d- = X t di in the sense of boolean arithmetic. 

(c) For any matrix X G M m ' n without null rows or columns, the symmetric 
boolean matrices Z = XX 1 and Z' = X l X have diagonal entries 1 and 
induce partitions that are X / X 1 -related, and agree with the partitions in- 
duced by higher powers of Z and Z' or on the basis of Z i X and X(Z'Y 
for any I G N. For t ^ m — l,n — l, the partition blocks in Z and Z' have 
entries 1 throughout, and Z e X and X(Z') have entries 1 in all positions 
relating elements from matching partition sets. 

Observation 3.11. For a symmetric boolean matrix Z G M n ' n with Z^d = 1 for 
all d G [n], the characteristic vectors dj of the partition [n] = [J i£l Di induced 
by Z satisfy the following 'eigenvector' equation in terms of boolean arithmetic: 

Zdi = dj (boolean), for all i £ I. 
3.2 Eigenvalues and -vectors 

Lemma 3.12. If Z G M n ' n is doubly stochastic, then it has eigenvalue 1. If Z 
is doubly stochastic and irreducible with strictly positive diagonal entries, then 
the eigenspace for eigenvalue 1 has dimension 1 and is spanned by the vector 
d := (1, . . . , 1)*. 

Proof. Clearly Zd = d for any stochastic matrix Z. 

If Z is moreover irreducible with positive diagonal entries, then by Observa- 
tion [321 '■= Z n ~ x has strictly positive entries and, being doubly stochastic, 
therefore entries strictly between and 1. 

If v is an eigenvector for eigenvalue 1 of Z, then also of Z* . If v = 
(v±, . . . , v n ), this is equivalent to 

Vi = Z*-Vj for all i G [n]. 

Looking at an index i for which Vj ^ Vi for all j, we see that the maximal «j 
is a convex combination of the Vj to which every Vj contributes. This implies 
that all Vj = Vi, so that v is a scalar multiple of d as claimed. □ 

Corollary 3.13. (a) Let Z G R n,n be doubly stochastic with positive diago- 
nal, and [n] = U^-Dj a partition with Z^u, = for i ^ j and such that 
the minors Zjj^ are irreducible for all i. Then the eigenspace for eigen- 
value 1 of Z is the direct sum of the 1-dimensional subspaces spanned by 
the characteristic vectors dj of the partition sets Di . 
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(b) If Z = X l X G W l ' n for some doubly stochastic matrix X, then the 
eigenspace for eigenvalue 1 is the direct sum of the spans of the char- 
acteristic vectors d, from the unique partition [n] = of [n] induced 
by Z according to Lemma \3. 3\ 

Proof Towards (a), it is clear that Zdi = dj, so that each dj is an eigenvector 
with eigenvalue 1. Let Vi := span(ed: d G Dj); then W 1 = (J^ Vj is a direct 
sum decomposition, and Zrj^i = for j ^ i implies that Z maps Vi to itself. 
Therefore any eigenvector v with eigenvalue 1 decomposes as v = Vj, where 
v,j G Vi, in such manner that Zvj = Vj. Since the restriction of Z to V, is 
irreducible with positive diagonal, Vj G span(dj) by Lemma 13.121 as claimed. 

Statement (b) is s direct consequence, since Z is symmetric with positive 
diagonal. □ 



3.3 Stable partitions 

Definition 3.14. Let A G ]R n ' n , [n] = Uie/A be a partition. We call this 
partition a stable partition for A if there are numbers (sjj)ije/ and (tij)ij^i 
such that for all i,j G /: 

d G A =>• ^2 A dd , = Sij and ^ A M = Uj. 

d'eDj d'eDj 

If there are Sjj such that Yld'eD ■ Aw = s «j f° r au d £ Di, we call the 
partition row-stable; similarly, for such that X^d'eD ^d'd = ijj for all d G A, 
column-stable. 

For symmetric A, column- and row-stability are equivalent (with tij = s^). 

Note that the row and column sums in the definition are the A-components 
of Adj and of d^A = (A t dj) t , respectively. So, for instance, row stability 
precisely says that 

Adj = y^Sjjdj G (J)span(di). 

i i 

Lemma 3.15. Let A G R n ' n commute with some symmetric matrix of the form 
Z = XX 1 G IR n ' n for some doubly stochastic X G R n,n . Then the partition 
[n] = Uj-D; °f [ n ] induced by Z according to Lemma \3.3\ is stable for A. 

Proof. We use the characteristic vectors dj of the partition sets. By Corol- 
lary 13.131 the eigenspace for eigenvalue 1 of Z is the direct sum of the spans of 
the vectors dj. 

Now ZAdi = AZdi = Adi shows that Adi is an eigenvector of Z with 
eigenvalue 1, whence 

Adi G (J)span(dj). 

i 

It follows that the partition [n] = (Ji-A i s row-stable. 

Note again that (Adj) a = ^<2'e.D Aw an d Adj G ®, z span(dj) precisely 
means that this value (Adj)d only depends on the partition set Di to which d 
belongs. I.e., Y^d'eD A dd' = Sij for all d G A- 
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As Z = XX 1 = Z t ,A t commutes with Z if A does: A l Z = A l Z l = (ZAf = 
(AZy = Z l A 1 = ZA l . The above reasoning therefore shows that the partition 
into the Di is row-stable for A t as well, hence column stable for A. Hence it is 
stable for A. □ 

NB: symmetry of A is not required here. It is essential for deriving commu- 
tation of A (and A 1 ) with Z = XX 1 from an equation of the form AX = XB, 
as we shall see below. But first a corollary from the argument just given. 

Corollary 3.16. Let A commute with Z = XX 1 and B commute with Z' = 
X t X, where X is doubly stochastic (cf. Lemma \3.15\) . Then the partitions 
induced by Z and Z' , which are X -related by Lemma [Ol are stable for A and 
B, respectively. 



Aside: boolean arithmetic 

We give a separate elementary proof of the analogue of Lemma [3.15l for boolean 
arithmetic. Here the definition of a boolean stable partition is this natural 
analogue of Definition 13.141 

Definition 3.17. A partition [n] = \J i£l Di is boolean stable for A £ B n,n if, in 
the sense of boolean arithmetic, Yld'eD- Add' and J2d'eD Ad'd only depend on 
the partition set i for which d £ D, L . 

Note that boolean stability implies that, for the characteristic vectors dj of 
the partition, (Adj)d = Yld'eD Add' 1S t ne same for all d £ D^, so that also 
here Adj is a boolean linear combination of the characteristic vectors dj. 

Lemma 3.18. Let A € B n,n commute, in the sense of boolean arithmetic, with 
some symmetric matrix of the form Z = XX 1 £ B n,n with entries Zdd = 1 
for all d £ [n]. Then the partition [n] = [J^Di induced by Z according to 
Lemma \3.10\ is boolean stable for A. 

Proof. Recall from Observation 13.111 that the characteristic vectors dj of the 
induced partition behave like eigenvector with eigenvalue 1 for boolean arith- 
metic: Zdi = dj. Moreover, we may assume that Zdd! = 1 iff d and d' are in the 
same partition set (after passage to Z n ~ l if necessary). Let us write {£ £ Dj} 
for the boolean truth value of the assertion I £ Dj. Then, for d £ Di, 

Ed'eD^dd* = (Adj)d = (AZdj)d 

= (ZAdj)d = Y,k,e z dkA kt {I £ Dj] = J2 keDi)teDj A M 

does indeed not depend on d £ Di, whence the partition is boolean row-stable. 
Column-stability again follows from similar considerations based on commuta- 
tion of Z = Z l with A 1 . □ 
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4 Fractional isomorphism 



4.1 C 2 -equivalence and linear equations 

The adjacency matrix of graph A is the square matrix A with rows and columns 
indexed by vertices of A and entries A aa i = 1 if aa' is an edge of A and A aa / = 
otherwise. By our assumption that graphs are undirected and simple, A is a 
symmetric square matrix with null diagonal. It will be convenient to assume 
that our graphs always have an initial segment [n] of the positive integers as 
their vertex set. Then the adjacency matrices are in M n,n C M n ' n . Throughout 
this subsection, we assume that A and B are graphs with vertex set [n] and 
with adjacency matrices A, B, respectively. It will be notationally suggestive, to 
denote typical indices of matrices a, a', . . . € [n] when they are to be interpreted 
as vertices of A, and b,b', . . . € n\ when they are to be interpreted as vertices 
of B. 

Recall (from the discussion in the introduction) that two graphs A, B are 
isomorphic if, and only if, there is a permutation matrix X such that AX = XB. 
We can rewrite this as the following integer linear program in the variables X ab 
for a, b G [n]. 



ISO 








X a V — X a r b — 1, 




b'e[n] 


a'e[n] 






X a 'b = Xab'Bb'b, 




a'e[n] 


b'e[n] 






x ab > 


for all a, b G [n]. 



Then A and B are isomorphic if, and only if, ISO has an integer solution. 



Definition 4.1. Two graphs A,B are fractionally isomorphic, A~B, if, and 
only if, the system ISO has a real solution. 

Observe that graphs are fractionally isomorphic if, and only if, there is a 
doubly stochastic matrix X such that AX = XA. 

Note that fractionally isomorphic graphs necessarily have the same number 
of vertices (this will be different for the boolean analogue, which cannot count). 

The established theorem on fractional isomorphism, by Ramana, Scheiner- 
man and Ullman from [15^ [16] , relates fractional isomorphis to the colour re- 
finement algorithm ('iterated degree sequences' in |16| ) introduced in Section [2] 
and stable partitions ('equitable partitions' in [IB]). 

A stable partition of the vertex set of an undirected graph is a stable par- 
tition [n] = {J ie jDi for its adjacency matrix in the sense of Definition 13.141 
Reading that definition for the (symmetric) adjacency matrix A of a graph on 
[n], and thinking of the partition sets Di as vertex colours, stability means that 
the colour of any vertex determines the number of its neighbours in every one 
of the colours. This is stability in the sense of colour refinement; it means that 
the colour refinement algorithm produces the coarsest stable partition. 
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The characteristic parameters for a stable partition [n] = \^} i£l Di for A 
are the numbers Sy = such that Sy = ^ d / g£) . ^4dd' for all d G -Dj. (As A 
is symmetric, the parameters tij of Definition 13.141 are equal to the Sij.) We 
call two stable partitions [J iGl Di for a matrix ^4 and Uigj-^i f° r a matrix 5 
equivalent if I = J and = \D[\ for all i € I and = sfj and for all i,j G /. 

Lemma 4.2. „A and ,8 are C 2 -equivalent if, and only if, there are equivalent 
stable partitions \J i€ jDi for A and Uie-T^i f or 

Proof. The forward direction follows from Theorem 12.31 because the colour 
refinement algorithm computes equivalent stable partitions of A and B. 

To establish the converse implication, we use the bijective 2-pebble game, 
which characterises C 2 -equivalence by Theorem l2.2l Suppose we have equivalent 
stable partitions \J i€l Di of A and UjeJ^i °^ B - Then it is a winning strategy 
for player II to maintain the following invariant for every position p of the game: 
p is a local isomorphism (that is, if dom(p) = {a, a'} then a = a' if, and only 
if, p(a) = p(a'), and a and a' are adjacent in A if, and only if, p(a) and p{a') 
are adjacent in B), and if a G dom(p) fl Di then p{a) G D[. It follows easily 
from the definition of stable partitions that player II can indeed maintain this 
invariant. □ 

Theorem 4.3 (Ramana-Scheinerman-Ullman). Two graphs are C 2 -equivalent 
if, and only if, they are fractionally isomorphic. 

Proof. In view of Lemma 14.21 it suffices to prove that A and B have equivalent 
stable partitions if, and only if, they are fractionally isomorphic. 

For the forward direction, suppose that we have equivalent stable partitions 
Uie/A for A and \JieJ D i for B - For a11 a G A, & G V- we let 

X a b ■■= 5(iJ)/m, 

where ?ij := |L>j| = {D 1 ^. (Here and elsewhere we use Kronecker's 5 function 
defined by S(i,j) = 1 if i = j and 5(i,j) = otherwise.) An easy calculation 
shows that this defines a doubly stochastic matrix X with AX = XB, that is, 
a solution for ISO. 

For the converse direction, suppose that X is a doubly stochastic matrix 
such that AX = XB. Since A and B are symmetric, also X 1 A = BX l , and 

AXX 1 = XBX 1 = XX 1 A and BX f X = X 1 AX = X l XB, 

show that A commutes with Z := XX 1 and B with Z' := X l X. 

From Lemma f3. 151 and Corollary l3.161 the partitions [n] = Uie/-^? ana - i n 1 = 
[Ji^jD'i that are induced by the symmetric matrices Z and Z' are X-related 
and stable for A and for B, respectively. We need to show that |Dj| = [D'^ and 
that the partitions also agree w.r.t. the parameters Sj,-. 

By Lemma 13.71 we have \Di\ = [D'^ and 

di = Xd'i and = X l d h (2) 
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where d, and for i € / are the characteristic vectors of the two partitions. 
Thus for all i, j € /, 

(d'rfBd'j = (X^ifBX^j = d^XBX^j = djAXX^j = d\AZdj = djAdj, 

where the last equality follows from the fact that dj is an eigenvector of Z with 
eigenvalue 1 by Corollary 13, 131 

Note that d\Adj is the number of edges of A from Di to Dj. By stability 
of the partition, we have sfj = d\Adj/\Di\ and similarly sfj = (d'^Bd'j/lD'A, 
so that sfj = sfj. □ 

4.2 L 2 -equivalence and boolean linear equations 

W.r.t. an adjacency matrix A E B n,n , a boolean stable partition [n] = [J iGl Di 
has as parameters just the boolean values 

ti = |0 ifA A23 .=0, 
Lij { 1 else. 

Boolean (row-)stability of the partition for A implies that ifj = 1 if, and only 
if, for each individual d £ Di there is at least one d! € Dj such that Add' = L 
and similarly for column stability. 

To capture the situation of 2-pebble game equivalence, though, we now need 
to work with similar partitions that are stable both w.r.t. A and w.r.t. to the 
adjacency matrix A c of the complement of the graph with adjacency matrix A. 
Here the complement of a graph A is the graph A c with the same vertex set as 
A obtained by replacing edges by non-edges and vice versa. Hence A c aa , = 1 if 
A aa ' = and a ^ a', and A c aa , = otherwise. While a partition in the sense of 
real arithmetic is stable for A if, and only if, it is stable for A c , this is no longer 
the case for boolean arithmetic. Let us call a partition that is boolean stable 
for both A and A c , boolean bi-stable for A. 

Then the following captures the situation of two graphs that are 2-pebble 
game equivalent. We note that 2-pebble equivalence is a very rough notion 
of equivalence, if we look at just simple undirected graphs - but the concepts 
explored here do have natural extensions to coloured, directed graphs, and form 
the basis for the analysis of /s-pebble equivalence, which is non-trivial even for 
simple undirected graphs. 

L 2 -equivalence of two graphs does not imply that the graphs have the same 
size. In the following, we always assume that A, B are graphs with vertex 
sets [m], [n] respectively and that A € M' m ' m and b 6 B n,n are their adjacency 
matrices. We call two bi-stable partitions [m] = [J i€l Di for A (and A c ) and 
[n] = IJj e j-Di for B (and B c ) b-equivalent if / = J and if- = ifj and ifj = ifj 
and for all i,j £ /. Note that b-equivalence does not imply that \Di \ = |-E^|. 

Lemma 4.4. A and B are L 2 -equivalent if, and only if, there are b-equivalent 
bi-stable partitions [m] = \^} ieI Di for A and [n] = Uiej-^i f or B. 
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Proof. The proof is analogous to the proof of Lemma 14.41 For the backward 
direction, we need bistability to guarantee that player II can maintain position p 
that preserve adjacency, non-adjacency, and (in)equality. Stability alone would 
only enable her to maintain adjacency and equality. □ 

Definition 4.5. A and B are boolean isomorphic, A ~ b ooi B, if there is some 
boolean matrix X without null rows or columns such that AX = XB and 
A C X = XB C . 

Theorem 4.6. Two graphs are L 2 -equivalent if, and only if, they are boolean 
isomorphic. 

Proof. For the forward direction, suppose that A =f_ B, and let [m] = Ui<£<s-^ 
and [n] = Ui<i< s -^i be the similar boolean bi-stable partitions. For all a € 
Di, b £ Dj we let X ab := 5(i,j). This defines a boolean matrix X E M m ' n with- 
out null rows or columns. One checks that AX = XB, in boolean arithmetic: 
for a € Di and b € D'-, and for the characteristic vectors dj and d^ for the 
partitions, 

(AX) ab = T,k A °kXkb = (Ad j ) a = t$ 

= L? j = (Bd> i ) b = ((d' i ) t B t ) b = E k XakB kb = (XB) ab . 

The argument for A C X = XB C is completely analogous. 

For the converse, suppose that A ~ b ooi B, and let X be a boolean matrix 
without null rows or columns such that AX = XB and A C X = XB C . Since A 
and B are symmetric, also X l A = BX l X t A c = B c X t , and 

AXX 1 = XBX 1 = XX 1 A and BX l X = X 1 AX = X l XB, 

and the analogue for the complements, show that both A and A c commute 
with Z := XX 1 and both B and B c commute with Z' := X l X. Moreover, the 
matrices Z and Z' have entries 1 on the diagonal. 

From Lemma 13.181 and the straightforward analogue of Corollary 13.161 the 
partitions [m] = [j ie jDi and [n] = (Jiei-^i induced by the symmetric matrices 
Z and Z' are X-related and boolean bi-stable for A and for B, respectively. We 
need to show that these partitions also agree w.r.t. the characteristic Lij. By 
Lemma 13.101 the characteristic vectors d- and d^ of the partitions are related 
by di = Xd'i and d[ = X*dj in the sense of boolean arithmetic. 

Since AX = XB and as the dj are boolean eigenvectors of Z = XX t with 
eigenvalue 1 by Observation 13. 1 ll 

ifj = (d' i ) t Bd' j = (X i d i ) t BX t dj = d\XBX t dj 
= d\AXX l dj = d\AZdj = d\Adj = ifj. 

The argument for iff = if* is strictly analogous. □ 
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5 Relaxations in the style of Sherali— Adams 



In this section we refine the connection between the Sherali-Adams hierarchy 
of LP relaxation of the integer linear program ISO to equivalence in the finite 
variable counting logics or the higher-dimensional Lehman-Weisfeiler equiva- 
lence. 

NB: our parameter k ^ 2 is the number of pebbles, or the variables available 
in the A:-variable logics C k or L fc . 

As before, A and B are graphs with vertex sets [m] and [n], respectively, 
and A and B are their adjacency matrices. We denote typical elements and 
tuples of elements from A and B as a = (a\, . . . , a r ) or b = (bi, . . . , b r ), for ^ 
r ^ k; correspondingly, we typically denote entries of the adjacency matrices 
as, e.g., A aa i. This device will help in an intuitive consistency check also in 
matrix compositions like AX with entries (AX) a t, if A is an m x m matrix 
over [m] and X, as an m x n matrix, relates [m] and [n] through entries X a ^. 
(AX) a b = Y^ a ' A aa iX a >i, (which rightly suggests paths of length two in a suitable 
composition of graphs A and G(X)). 

Types. Let etp(a) denote the equality type of tuple a in A, atp(a) its quantifier- 
free type, and tp(a) its complete type in the logic C fc , that is, the set of all 
C fc -formulae <p(x) such that A satisfies <p(a). Note that a i— > b constitutes a 
local bijection if, and only if, etp(a) = etp(b), and a local isomorphism if, and 
only if atp(a) = atp(b). 

Types with parameters are denoted as in tp a (a) for the type of a w.r.t. to 
the fixed parameter tuple a; we may treat types as if they were formulae, with 
free variables for the main argument (as opposed to the parameter tuple), as 
in (tp a (a)) viewed as a formula with parameters for a and a free variable x 
assuming the role of a. By logics with restrictions on the number of variables, 
however, these parameters are accessible as assignments to variables; they thus 
count towards the variables in formulae, and are not treated as constants. The 
distinction between plain types and types with parameters, therefore, is one of 
semantic intention rather than syntactic. It is often suggestive when it comes 
to counting realisations. E.g., we let 

#^(tp(x)=tp(a)) 

denote the number of tuples a' in A that realise the type of a, i.e., those a' 
for which A, a' A, a. If the structure in which realisations are counted is 
obvious or does not matter because of C fc -equivalence, we drop the superscript 
and write e.g. just # x instead of # x or 

The number of realisations of the 1-type of a over parameters a (in A) is 
denoted by 

#x(tp a (x) = tp a (a)) (= # x (tp(ax) = tp(aa))). 
Regarding the counting of realisations we note that generally 

# xx (tp(xx) = tp(aa)) = # x (tp(x)=tp(a))-#a.(tp a (s)=tp a (a)). (3) 
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The equations. In the following we use variables X p indexed by subsets 
p C [m] x [n] of size up to k — 1; we may think of such p as being specified by two 
tuples a and b of length \p\ that enumerate the first and second components 
of the pairs in p in any coherent order. In this sense we write p = ab. As 
remarked before, p is a local bijection between A and B iff etp(a) = etp(b), 
and a local isomorphism iff atp(a) = atp(b) (and neither of these conditions 
depends on the chosen enumeration of tuples in p, which gives rise to the order 
of components in both a and b). 

The augmentation of p C [m] x [n] by some pair ab G [m] x [n] is simply 
denoted p^ab. It is crucial that the notation p^ab does not refer to a tuple of 
pairs but to a set of pairs, in which the pair (a, b) is not distinguished. 

For further reference we isolate and name equation types as follows. For 
given n, m ^ 1 and matrices A G M n,n and B G B m,m : 

X % = 1 Cont(O) 
for |p| = £ — 1, a G [m], 6 G [n] 

Yla> Aaa>X p ~ a i b = J2b' X p~ab'Bb'b j COMP(^) 

for |p| = £ - 1, a G [m] , b G [n] J 

Here leveZ £ refers to ^ as the size of the pairings ab in the typical variables 
X a b involved; note that the size of p mentioned in X p - a b therefore remains 
one below this I. In the generic formats for Cont(^) and Comp(^) above, we 
assume I ^ 1. Note that the combination of Cont(£) and Comp(£) for I = 1 
precisely corresponds to the equations for fractional isomorphism. 

If we think of the matrix entries (A" ab ~ ab ) ae [ n ] be[m] as specifying extensions 
of a h4 b in form of a distribution on possible pairings and, then equa- 
tions Cont(£) may be seen as continuity conditions, while equations Comp(^) 
specify compatibility conditions with the edge relations encoded in A and B. 
Variants of the compatibility conditions can be expressed for matrices other 
than the adjacency matrices A and B that we primarily think of. We saw 
one such variation in the discussion on boolean isomorphisms above, where 
Comp(1) was postulated for both A, B and A c , B c . Further variants will play 
a role in Section 15.41 

5.1 S her ali— Adams of level A; — 1 

For k ^ 2, the level-{k — 1) Sherali- Adams relaxation of the integer linear 
program ISO consists of the collection of the equations Cont(£) and Comp(^) 
for £ < k: 



Cont(^) 
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ISO(fc-l) 




X$ = 1 and "I 






> Cont(^) for £ < k 


for p < k — 1, a G [m], 6 € J 




for p < /c — 1, a G [m], & G [n] 


J> Comp(^) for £ < 


X p > for |p| < fc - 1 





5.1.1 From C -equivalence to a level k — 1 solution 

Assume that A Z3. This implies that ^4 and /3 realise exactly the same types 
of r-tuples for r ^ k and with the same number of realisations: 

#£(tp(x)=tp(a)) = #»(tp(x)=tp(a)) (4) 

and similarly for all types tp(b) of r-tuples in B for r ^ k. In particular 
m = \A\ = \B\ = n so that both structures have domain [n\. 

If tp(a) = tp(b), where a and b are r-tuples for r ^ k — 1, then, for any 
a G [re], there are b G [n] such that tp(b&) = tp(aa); and for any such choice of 
b we find (cf. equation ([3|)): 

#* (tp a (x)=tp a (o)) = #4(tp(xx) = tp(aa)) / #£(tp(x) = tp(a)) 
= #^(tp(xx) = tp(aa)) / #£(tp(x)=tp(a)) 
= #^(tp(xx) = tp(bfe)) / #B( tp (x) = tp(b)) 
= #f(t Pb (x)=tp b (S)). 

Similarly, for r-tuples a and b such that tp(a) = tp(b), where r ^ k — 2 (!), 
and for any a and b, there are a and b such that tp(b66) = tp(aaa) and 

#4(tPa(^)=tPa(««)) = #5,(tPbM=tPb(W»))- (6) 
For the desired solution put 

X p := «5(tp(a),tp(b)) / # x (tp(x) = tp(a)), (7) 
for p = ab, < \p\ < k. 

For the denominator note that # x (tp(x) = tp(a)) = # x (tp(x) = tp(b)) 
whenever tp(a) = tp(b). Clearly X p ^ 0. Note that X p ^ implies tp(a) = 
tp(b), which implies that atp(a) = atp(b) whereby a h > b is a local isomor- 
phism. 

We check that the given assignment to the variables X p satisfies all in- 
stances of the equations Cont(£) and Comp(£) in Sherali-Adams of level k — 1. 
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In fact, the X p as specified by (J7|), satisfy all instances of the continuity equa- 
tions Cont(^) of levels I ^ k (!) and all instances of the compatibility equa- 
tions Comp(^) of levels I < k, while level k — 1 Sherali-Adams just requires 
both equation types for levels i < k. 

Consider an instance of Cont(£) of level i ^ k, i.e., for \p\ < k, with 
p = ab, a € [n]. If tp(a) ^ tp(b), then both sides of the equation are zero. In 
case tp(a) = tp(b), let b G [n] be such that tp(bfr) = tp(aa) (such b exist as 
tp(a) = tp(b) and since \p\ < k). Then 

Y.b> X p~aV = Efe' £(tp(aa),tp(b&')) / #xx(tp(xx) = tp(aa)) 
= #x(tp b (a;) = tp a (a)) / # xx (tp(xx) = tp(aa)) 
= #*(tPb(aO=tPb(6)) / #xx(tp(xx) = tp(b6)) 
= # x (tp(x) = tp(b))- 1 =X P , 

where the crucial equality leading to the last line is from equation ([3]). 

Consider now an instance of equation Comp(£) of level i < k, i.e., with 
\p\ < k — 1, with p = ab, a € [n], b £ [n\. Again, the case of tp(a) ^ tp(b) is 
trivial. So we are left with the case of p = ab with tp(a) = tp(b) and \p\ ^ k — 2. 
These imply that there are a and b such that tp(aaa) = tp(b&6). Then 

= Ea> A aa>S(tp(sLa'),tp(bb)) / # xx (tp(xx) = tp(bb) ) 

# y (edge{ay) A tp a (y) = tp a (a)) 

#xz(tp(xx) = tp(b6)) ^ 

# xy {edge{xy) A tp a (x) = tp a (a) A tp a (y) = tp a (a)) 
# xx (tp(xx) = tp(b6)) • #x(tp a (2;) = tp a (a)) 

# xy (edge(xy) A tp a (x) = tp a (a) A tp a (y) =tp a (a)) 
# x (tp(x) = tp(b)) • #x(tPb(a:)=tPb(&)) • #*(tp a (x) = tp») ' 

where we use instances of equation Q, and, in the passage form the third to 
the forth line, artificially count over all realisations of tp a (a) instead of just the 
fixed parameter a, and compensate for that in the denominator. 
The counting term in the enumerator of this expression, 

# xy {edge{xy) A tp a (x) =tp a (a) A tp a (y) =tp a (a)) , 

is the sum of the number of realisations of all those types (tp a (a",a')) that 
simultaneously extend tp a (a), tp a (a) and contain the formula edge(xy). Each 
one of these types has exactly the same number of realisations in A as the cor- 
responding type that simultaneously extends tp b (6), tp b (6) and contains the 
formula edge(xy). By symmetry of the graphs under consideration, edge(xy) is 
equivalent with edge(yx) and what we obtained in ([8]) coincides with the corre- 
sponding evaluation of the right-hand side of this instance of equation Comp(^) 
as desired: 
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J2b> Bb'bX p - a bi 



= E&' 5&'&<Ktp(aa),tp(b6')) / #xx(tp(xa;) = tp(aa)) 

# xy (edge{yx) A tp b (x) =tp b (b) A tp a {y) = tp a (a)) (9) 
#xx(tp(xx) = tp(aa)) • # x (tp b (x) = tp b (6)) 
# xy (edge(yx) A tp b (x) = tp b (6) A tp b (y) = tp b (6)) 
# x (tp(x) = tp(a)) • #x(tp a (x) = tp a (a)) • #*(tp b (x)=tp b (6)) ' 

Corollary 5.1. If A =q B, then there is a solution (X p ) for the combination 
of the continuity equations Cont(£) of levels £ ^ k (!) with the compatibility 
equations Cont(£) of levels t < k. 

5.1.2 From a level k — 1 solution to C <fc -equivalence 

In the following we discuss what it means that some admissible real or ratio- 
nal non- negative assignment to the variables X p for all \p\ < k satisfies the 
equations Cont(£) and Comp(£) for t < k, i.e., ISO(k-l). 

Lemma 5.2. // (X p )\ p \ <k is a solution to ISO(A; — 1), then X p ^ implies 
that 

(a) p is a local bisection; and, strengthening this, that 

(b) p is a local isomorphism. 

Proof. For (a) we only need to use instances of the continuity equations Cont(^) . 
Suppose that p = ab is not a local bijection, w.l.o.g. (by symmetry) assume 
that there are a and b\ ^ 62 such that (o, 61), (a, 62) G P- For po := p\ (a 5 ^2) we 
clearly have i := |po| < k — 1, and looking at the instance of Cont(£) for this 
Po and a, we find that the two summands for b' = 6j, i = 1, 2, both contribute 
to the left-hand side. So the equation and non-negativity of all X-assignments 
imply that X po + X p ^ X po , whence X p = 0. 

For (b) we use (a) and instances of the equations Comp(^) . The claim is 
true for p = 0, and we lift it to all other p by induction. Note that for \p\ = 1, 
p = ab cannot fail to be a local isomorphism (in undirected, loop-free graphs). 

Assume then that X p ~ ab > 0, that < |p| < k — 1 and that (b) holds true 
for p. Note that equations Cont(|p| + 1) and X p ~ ab > imply that X p > 0. 
Hence, by the inductive hypothesis, p is a local isomorphism. 

By (a), p~ab is a local bijection, and we check that it also must be a local 
isomorphism. For this it remains to show that, for instance (a, a\) is an edge of 
A iff (b,bi) is an edge of B. Since the edge relations are symmetric, it suffices 
to show that 

(i) A ai>a = 1 => B blb / 0, and 

(ii) B bM = 1 A aai ^ 0. 

For (i) we use this instance of equation Comp(£) for I := |p| + 1: 

^2 A aia 'X p ~ a / b = X p ~ aib /B b i b . 

a' b' 
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The right-hand side reduces to the single term XpBf,^ because a\ € dom(p). 
As the left-hand side is positive if A aita = 1 and X p ~ ab > 0, (i) follows. 

An analogous argument for (ii) is based on the instance Yl a ' ^aa'^p^a'bx = 
^2 b , Xp-ayBb'bi of equation Comp(£). □ 

C <fc -equi valence 

A solution for the variables X p satisfying ISO(/c — 1) is in fact not strong enough 
to guarantee C fe -equivalence, but a slightly lesser equivalence, 

A =f B, 

which we characterise in terms of a modified, weak bijective k-pebble game over 

A, B. The game is played by two players. If m / n, player II loses immediately. 
Otherwise, a play of the game proceeds in a sequence of rounds. Positions of the 
game are sets p C [m] x [n] of size \p\ < k — 1. Normally, the initial position is 0, 
but we will also consider plays of the game starting from other initial positions. 
A single round of the game, starting in position p, is played as follows. 

1. If \p\ = k — 1, player I selects a pair ab 6 p. If \p\ < k — 1, he omits this 
step. 

2. Player II selects a bijection between [m] and [n] (recall that m = n). 

3. Player I chooses a pair a'b' from this bijection. 

4. If p + : = p^a'b' is a local isomorphism then the new position is 

f {p\ab)~a'b' if \p\ = k — 1, 
P ■= < 

[ p^a'b' if \p\ < k - 1. 

Otherwise, the play ends and player II loses. 

Player II wins a play if it lasts forever, i.e., if m = n and she never loses in step 
4 of a round. 

Note that the weak bijective A;-pebble game requires more of the second 
player than the bijective (k — l)-pebble game, because p + rather than just p' 
is required to be a local isomorphism. On the other hand, it requires less than 
the bijective /c-pebble game: the bijective A:-pebble game precisely requires the 
second player to choose the bijection without prior knowledge of the pair ab 
that will be removed from the position. A strategy for player II in the weak 
version is good for the usual version if it is fully symmetric or uniform w.r.t. 
the pebble pair that is going to be removed. 

However, this is only relevant if k > 3. The weak bijective 2-pebble game 
and the bijective 2-pebble game are essentially the same. 

Definition 5.3. A and B are C <k -equivalent, A =^ k B, if the second player 
has a winning strategy in the weak bijective fe-pebble game on A, B. 

Furthermore, for tuples a and b of the same length I < k we let A, a =^ fe 

B, b if the second player has a winning strategy in the weak bijective fc-pebble 
game on A, B with initial position ab. 
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Observation 5.4. A = 2 C B 44> A =^ 2 B, and for all k ^ 3: 
A=qB A =Q k B => A = k c ^ B. 

Remark 5.5. The weak bijective k-pebble game is equivalent to a bisimulation- 
like game with k — 1 pebbles where in each round the first player may slide 
a pebble along an edge of one of the graphs and the dublicator has to answer 
by sliding the corresponding pebble along an edge of the other graph. In this 
version, the game coresponds to the (k — 1) -pebble sliding game introduced by 
Atserias and Maneva JI]/. They prove that equivalence of two graphs with respect 
to the (k-l)-pebble sliding game implies that ISO(fc — 1) has a solution. In view 
of the equivalence of the sliding game with our weak bijective k-pebble game, this 
implies the backward direction of Theorem \5. 7| below. 

Let I n be the set of positions of the weak bijective fc-pebble game over A, B 
in which the second player has a strategy to survive through n rounds. Let 
~ n stand for the equivalence relation induced by I n , i.e., the transitive closure 
of the relation that puts a ~ n b if p = ab G I n . Note that ~ n is compatible 
with permutations in the sense that, for instance, a ~ b iff vr(a) ~ vr(b) for any 
7r G S n . We write vr(a) for the application of the permutation ir G S n to the 
components of a = (a±, . . . , a n ), which results in 7r(a) = (a n ^, . . . , a n ^). 

For n = 0, Iq consists of all size k — 1 local isomorphisms. We characterise 
I n +i and ~ n+1 in terms of I n by means of back&forth conditions for a single 
round: a ~ n+1 b (p = ab € I n +i) iff position ab is good in the following sense: 
for 1 ^ j ^ k — 1, the second player has a response that guarantees a target 
position in I n if the first player chooses index j. 

I.e., for each 1 ^ j ^ k — 1, the second player needs to have a between [m] 
and [n] such that for every (a, b) G pj 

atp(aa) = atp(bfe) and a jbj £ ^n- 

The first condition says that p^ab is a local isomorphism, the second that 
the new position is good for n further rounds. 

Note that, since A is a graph, the quantifier-free type atp(aa) is fully de- 
termined by atp(a) and the atp(a,a) for 1 ^ i ^ k — 1, which in turn are de- 
termined by atp(aja). The condition that atp(a) = atp(b) is a pre-condition 
for the round to be played; the condition that atp(aja) = atp(6j&) is part of the 
post-condition that p\(j)^ab is a local isomorphism, for all i apart from i = j. 

Let (aj)jg/ be an enumeration of the ~ n -classes over A and B. Then the 
above conditions on membership of p = ab in are equivalent to the fol- 

lowing: 

for each 1 $C j ^ k — 1, 

for every ~ n -class a, and 

for every quantifier-free type r](x,y): 

#^(a| GQAatp(o i a) = r ? ) = #f (b| G a A atp(6j6) = r?) . 

Note, towards the claimed equivalence, that these numerical equalities allow 
the second player to piece together a bijection that respects the partition of [m] 
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and [n] according to different combinations of a and 77, which in turn guarantees 
that any pair (a, b) drawn from the bijection respects this partition and hence 
leads to a position ajbj £ I n as required. 

Conversely, if one of these equalities were violated, then any bijection will 
have to have at least one pair that does not respect the partition of [m] and [n] 
w.r.t. the a and rj. If the first player picks such a bad pair (a, b), then the second 
player loses during this round because atp(aa) ^ atp(bfe), or the resulting new 
position a jbj is not in /„. 

For later use we state the condition on full C <fe -equivalence, corresponding 
to the stable limit of the above refinement step. For a € [m] fc_1 and b € [n] fe_1 , 
A,a=< k B,h iff 

for each 1 ^ j ' ^ k — 1, 
for all C <fc -equivalence classes a, and 
for every quantifier-free type r)(x,y): 
#^(a| € a A atp (oj-o) = rj) = #f (b| G a A atp(6 3 -6) 

From local isomorphisms to C <fc -equivalence. We observe that for any 
solution (X p ) of the level k — 1 equations, and for every \p\ ^ k — 2 such that 
X p ^ 0, the matrix 

V /aG[m],bG[n] 

is doubly stochastic by equations Cont(£). In particular, the continuity equa- 
tions, even for I = 0, also enforce that A and B have the same number of 
vertices, and we may assume that m = n. 

Lemma 5.6. For k ^ 3, if (^p~a&)|p|<fc-2,ae[n],6e[n] ^ s a solution to ISO(k — 1) 
then for all a € [n] k ~ l and b E [n] fe_1 : 

X ah > =>• A a =< fc B, b. 

Proof. Consider tuples a and b of length k — 1 such that X a b > 0. It suffices to 
show that, for each 1 ^ j ^ k — 1, the second player has a response pj in a single 
round played in component j that guarantees a resulting position a'b' = ayby 
for which again X^w > 0. 

Fix some j. Let a := aj, b := bj and p such that ab = p^afrU Since 
X ah > 0, equations Cont(^) imply that also X p > 0. Note that \p\ < k — 2. 
The matrix Y defined by Y a b := Xp~ a {,/X p is doubly stochastic, with a strictly 
positive entry in the position ab under consideration. 

By Corollary 13.161 Z = YY t and Z' = Y l Y are symmetric and doubly 
stochastic with positive entries on the diagonal and induce y-related partitions 
[n] = \J i&I Di and [n] = {J^jD^ that are stable w.r.t. A and B, respectively. As 
discussed in the proof of Theorem l4.3l cf. equation (j2J), the characteristic vectors 
dj and d- of these stable partitions are related according to d^ = Y*dj and d.; = 

5 Note that ab = p~~ab just specifies the subset p consisting of pairs in a 1— b other than 
(a, b); our notation should not wrongly suggest an appeal to ordered tuples. 
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Yd^. Similarity of the partitions as stated in the proof of Theorem 14.31 implies 
that the partitions agree w.r.t. sizes of the partition sets, \Di\ = \D[\ = m and 
w.r.t. the characteristic counts v& = vf-, where u£ = d'Ad, and vf- = (d')*i?d'. 

Because = X p ~ ab = Y ab > 0, a € and b G for the same k € I. It 
follows that, for every i G I, 

\{a' 6 Di : A aa , = 1}\ = \{b' G D[: B w = 

For this observe that these counts are fki/ n k- The second player may therefore 
choose a bijection that bijectively maps Di to D[ for i 6 I in such a manner 
that for every pair (a', 6') in this bijection, (a, a') is an edge in A iff (b, b') is an 
edge in £>. 

If the first player now picks any pair (a', b') from this bijection, then a' € Z?i 
and b' € -D« for some i € /, and the y-relatedness of the partitions implies that 
Ya'b' > an d hence Y a iyX p = X p ~ a /i,r > 0. By Lemma I5T21 (b), p^a'b' is a local 
isomorphism; and so is, by assumption, p~ab. As also (a, a') is an edge in A 
iff (6, b') is an edge in B by choice of the bijection, p + := p^ab^a'b' = ah^a'b' 
is a local isomorphism, too. The second player is thus guaranteed to reach a 
resulting position p' = a'b' = p^a'b' for which X p i > 0. □ 

Theorem 5.7. ISO(fc — 1) has a solution if, and only if, A =Q k B. 

Proof. The last lemma settles one implication. For the converse implication, 
it remains to argue that C <fc -equivalence suffices in place of C fc -equivalence to 
provide a solution to the Sherali-Adams relaxation of level k — 1. We now let 
tp(a) stand for the C <fc -type, or the C <fc -equivalence class of the tuple a. We 
may look at just tuples of length k — 1, by trivial padding through repetition 
of the last component say. Put 

x r .= i 

X p := 5(tp(a),tp(b)) / # x (tp(x)=tp(a)) (11) 
for p = ab, < \p\ ^ k — 1. 

We know that C <fc -equivalence refines C fc_1 -equi valence, and that an as- 
signment to X p according to C fc_1 -types of (k — l)-tuples was shown above to 
satisfy the continuity equations Cont(^) of levels £ < k, cf. Corollary 15.11 One 
can infer from this that also the refinement used here satisfies these equations. 

For satisfaction of equations Comp(£) of level £ < k, however, we need to 
appeal to something less than the extension property that boosts a and b to 
^-tuples aaa and hbb of the same C fc -type, as we used in connection with ([8]) 
above. 

Here as there, however, we only need to look at p = ab of size (up to) k — 2 
for which A, a =^ k B, b, because all other instances of the equation are trivially 
true with on both sides. We fix such p. 

Now, for any combination of C <fc -types a and j3 of {k — l)-tuples and 
quantifier-free type r] of a pair, 

#aa> (tp( a «) = « A tp(aa') = p A atp(aa') =rf) 
= #g, (tp(b&) = a A tp(bft') = p A atp(6&') = rj) . 
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This follows from an analysis of the C <fc -game from position p = ab through 
two rounds, in which the first player first gets the last pebble placed on any 
one of the possible choices for a, with responses b as provided by the second 
player's bijection (in exactly the same number); then the first player plays on 
that last component again, and replaces it with any one of the choices he may 
have for a' and its match b' according to the second player's bijection (again, 
the same number of positive choices). 

For given a and b, let now a := tp(aa) and /3 := tp(bfc). Then 

= Ea' A aa' <*(tp(aa'), tp(bb)) / # xa; (tp(xx) = tp(b&)) 

#^(tp(aa') = /3Aedge(aa')) 
# xa ,(tp(xa') = /3) 

#aa' (tp(aa) = a A tp(aa') = (3 A edge(aa')) 
# xa '(tp(xa') = /3) • # a (tp(aa) = a) 

#^a' (tp(aa) = a A tp(aa') =/3 A edge(aa')) 
# a /(tp(aa') = /3) •# x (tp(x) = tp(a)) ■ # a (tp(aa) = a) ' 

We transform this term further, using (|12p . a renaming of dummy variables in 
counting terms and the symmetry of the unique quantifier-free type r] deter- 
mined by edge(xy) in simple undirected graphs. The goal is to show equality 
with the corresponding term obtained for J2b> ^p"ab'Bb'b- Equality (fT2j) is used 
in the first step of these transformations, starting from the term just obtained: 

#aa' (tp(aa) = a A tp(aa') =/3 A edge(aa')) 
#a'(tp(aa') = 0) • # x (tp(x)=tp(a)) • # a (tp(aa) = a) 

#|, (tp(bfr) = a A tp(bfr') =0 A edge(66')) 
# 6 ,(tp(b6') = /3) • #x(tp(x)=tp(b)) • # 6 (tp(b6) = o) 

#|, (tp(bfr') = a A tp(bfe) =P_A edgejbb')) 
# b (tp(b&) = /3) • # x (tp(x) = tp(b)) • #6,(tp(b&') = a) 

#g (tp(b6 / ) = q Aedge(bfe')) 
# x (tp(x) = tp(b))-# v (tp(bb') = a) 

= Y.v B b'b 5(tp< fc (b6'),tp <fc (aa)) / # xx .(tp(xx) = tp< fc (aa)) 
= Eft' X p ~ a yBy h . 

□ 

5.2 The gap 

Based on a construction due to Cai, Fiirer, and Immerman [5], for k ^ 3 we 
construct graphs showing that A =^ k B ^4> A =q B, and that A = k ( ^ 1 B i> 
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A =Q k B. So the implications in Observation 15.41 are strict for k #J 3. 

Example 5.8. For every k ^ 3, there are graphs A and B such that A =^ _1 B 
but .4 ^< k B. 

Proof. We present the argument explicitly for k = 4; its variant for fe = 3 and 
the generalisation to higher k are straightforward. For A and # we use the 
straight and the twisted version of the Cai-Furer-Immerman companions of 
the 4-clique. 

We use copies of the standard degree 3 gadget 



#3 

o 
I 

E 

and its dual 



#3 

o 
I 

E 



(OUl,E), where 

{1,2,3} U {1,2, 3} (outer nodes) 

'Podd({l, 2, 3}) (inner nodes: odd subsets) 

{{i, sj: i G 0,s G I,i G s} U {(i, s) : i G O, s G /, i s} 



(0(JI,E), where 

{1,2,3} U {1,2,3} (outer nodes) 

"Peven({l) 2, 3}) (inner nodes: even subsets) 

{{i, s}: i G 0,S G J, i G s} U {(i, s) : i G O, s G /, : i G" s}. 



In each of these, we think of the three pairs of outer nodes as positive markers 
(1, 2, 3) and negative markers (1, 2, 3) for the elements of the set [3] = {1, 2, 3}, 
and of the four inner nodes as subsets s C [3] (of odd cardinalities in the case 
of H3, and of even cardinalities in the case of ^3); the edges incident with a 
particular s G / encode elementhood of i = 1, 2, 3 in s by linking s to i if i G s 
and to i if i G" s. Both graphs are bipartite with inner nodes of degree 3 and 
outer nodes of degree 2, which serve as ports to link copies of H3 and ^3. We 
really use coloured variants of H3 and S3 that distinguish the vertices of the 
distinct copies of H3 and -^3, and inner and outer as well as the three groups of 
port vertices (i.e., {i, i} for i = 1, 2, 3) within each of them. This is without loss 
of generality, since we may eliminate colours, e.g., by attaching simple, disjoint 
paths of different lengths to the members of each group of vertices. 

The non-trivial automorphisms of this decorated variant of H3 and H3 pre- 
cisely allow for simultaneous swaps within exactly two pairs of port vertices. In 
the sketch we distinguish positive element markers from negative ones by using 
filled and open circles; this is just to highlight the combinatorial source of the 
graph structure, and in (the decorated versions of) #3 and ^3 this distinction 
is not present. 



[3] {1} {2} {3} 



#3 




1 1 2 2 3 3 
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Let A consist of four decorated copies of H3, copies a,b,c,d say, that are 
linked by edges in corresponding outer nodes: 
(a, 1) is linked to (6, 1) and (a, 1) to (b, 1), 
(a, 2) is linked to (c, 1) and (a, 2) to (c, 1), 
(a, 3) is linked to (d, 1) and (a, 3) to (d, 1), 
(6,2) is linked to (c, 2) and (6,2) to (c,2), 
(d,2) is linked to (6,3) and (d,2) to (6,3), 
(d,3) is linked to (c, 3) and (d, 3) to (c, 3). 

In short: bridges are built between the 1-ports of 6/c/d with the 1/2/3-ports 
of a; between the 2-ports of 6 and c; and between the 2/3-ports of d and the 
3-ports of b/c. 



a 




B consists of three decorated copies of H3 (labelled a, 6, c) and one of H% (la- 
belled d), and linked in the same manner. 

We speak of the vertex sets in the individual decorated copies of H3 and H3 
in A and B as regions a, b, c and d. 

Observation 5.9. (a) The automorphism groups of both A and B are such 
that only the trivial automorphism fixes any three inner vertices from 
three distinct regions. Fixing one inner vertex each in two different re- 
gions leaves precisely one non-trivial automorphism, which swaps the two 
bridges between the outer vertices connecting the remaining two regions. 

(b) Any three corresponding regions in A and B are linked by a local isomor- 
phism. Any local isomorphism between two corresponding regions of A and 
B has precisely two extensions to each one of the remaining two regions, 
which are related by a swap of the bridges between those two regions. 
Extensions of these assertions to structures similarly obtained from k- cliques 
for k > 4 are straightforward. 

Property (b) can be used to show that A =j~ B, by exhibiting a strategy 
for the second player that maintains a local isomorphism between the unions 
of the pebbled regions. 

We now argue that A B. The first player can initially force a position 
in which pebble i in A is on the (positive) port node (a, i) for i = 1,2, 3; w.l.o.g. 
(viz., up to an automorphism of B) the pebbles in B are on (a,i) as well. 

Next we let the first player move pebbles 1 and 2 along paths of length 2 to 
the ports in copies 6 and c: pebble 1 to (6,1), pebble 2 to (c, 1). Necessarily, 
over B, these pebbles will then also be on the nodes with these labels. 

In the next two steps, we let the first player move these two pebbles along 
edges to the inner nodes (6, [3]) and (c, [3]) in copies 6 and c. The forced 
responses in B will put pebble 1 to one of (6, {!}) or (6, [3]), and pebble 2 
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to one of (c, {1}) or (c, [3]). The two skew combinations ((6, {1}), (c, [3])) or 
((&, [3]), (c, {1})) for pebbles 1 and 2 are bad for the second player, because the 
two pebbles end up at distance greater than 3 in B while their distance in A is 
3 - the first player can force a win in two rounds involving pebble 3. Up to an 
automorphism of B that fixes the location of the third pebble, we may therefore 
assume that the pebble configuration is ((&, [3]), (c, [3]), (a, 3)) in both A and B. 

In further moves along edges that take all three pebbles towards the port 
nodes of the d-regions in both A and B, the first player forces the configuration 
{(d, 2), (d, 3), (d, 1)) in both A and B. 

Since the ci-region of A is a copy of H3 while that of B is a copy of H3, 
however, all three pebbles have edges to the inner node (d, [3]) in A, but there 
is no such node in B. So a single C fc -round in which the fourth pebble in A is 
put on (d, [3]), lets the first player win the game (the first player can also win 
by moving one of the 3 pebbles along an edge in A to (d, [3])). □ 

Example 5.10. For every k ^ 3, there are graphs A and B such that A B 
but A ^ k c B. 

Proof. We describe the argument for the case k = 3, where we use variants of 
A and B as in the last proof, but with one marked inner node: in both A and 
B we mark the inner node (a, [3]) by a new colour (which can be eliminated by 
attaching a path of some characteristic length, as observed above). We denote 
these modified structures as A* and B*. In effect this means that the second 
player needs to respect moves to these marked vertices as if they were coloured 
in both the C 3 - and the C <3 -game: if the second player fails to pair (a, [3]) * 
with (a, [3]) 6 *, this mismatched pair would allow the first player an easy win. 
We claim that A* ^ B* while A* =^ 3 £>*• 

First, for A* ^\ B*, we let the first player play the first three rounds so that 
the inner nodes (b, [3]), (c, [3]) and (d, [3]) are pebbled in A*, and (unless the 
second player has lost already or will lose for trivial reasons involving the dec- 
orations) matched with inner nodes (b, s?,), (c, s c ) and some (d, Sd) in B*, which 
means that Sb,s c C [3] are of odd size while Sd C [3] is of even size. It follows 
that between at least two pairs of nodes from ((a, [3]), (b, [3]), (c, [3]), (d, [3]))^* 
and ((a, [3]), (b, Sj,), (c, s c ), (d, Sd)) 13 * , distances in A* and £>* are different: the 
nodes in A* are at pairwise distance 3; for at least one pair of the nodes in B* 
the distance is greater than 3. This is easily turned into a strategy for the first 
player to pebble along one of these short connecting paths in A*, alternating 
between two pebbles; this forces a mismatch w.r.t. to the target node, which is 
either pebbled (if in regions b, c, d) or coloured with the special marker path (if 
in region a), and in either situation the second player can be made to lose. 

For A* =q 3 B* we claim that the second player can maintain the condition 
that the current configuration (01, 02; b\, 62) 6 dom(A*) 2 x dom(£>*) 2 extends to 
a local isomorphism on the union of the a-region with those regions to which a\ 
and 02 (and thus b\ and 62) belong. In fact we may add an extra virtual pebble 
pair on ao := (a, [3])^* and 60 := ( a i [3]) S * and maintain a local isomorphism 
£ whose domain consists of up to three out of the four regions and such that 
£(cij) = bi for i = 0,1,2. Suppose, w.l.o.g., that in such a situation the first 
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player announces play on pebble 2, i.e., that the pair (02, 62) will be withdrawn 
at the end of the round. Let £0 be the restriction of £ to the a-region and the 
region of a\/b\. Since £0 covers at most two of the four regions, Observation 15.91 
guarantees extensions to local isomorphisms that 

(a) cover any one of the remaining (two or three) regions, and 

(b) at the same time respect a given pairing between the outer nodes of that 
new region in the direction of one of the (one or two) further remaining 
regions. 

From such extensions, the second player can piece together a bijection that 
allows her to maintain the desired condition, as follows. The chosen bijection 
extends £ to the (one or two) regions not covered by £ as follows. 

Case 1: 02/62 are inner nodes or outer nodes in the direction of a region cov- 
ered by £o- Extend £ by bijections obtained from extensions of £0 to local 
isomorphisms involving one extra region at a time, as in (a). 

Case 2: 02/62 are outer nodes in the direction of a further region not covered 
by £o- Extend £ to that further region according to an extension of £0 as a 
local isomorphism that also respects the neighbours of 02/62 hi this region, in 
the sense of (b); the extension to a remaining region (if there is such) can be 
completed as in Case 1. 

Any bijection pieced together like this is a good choice: 

• the second player does not lose during this round: any pair selected from 
the bijection belongs to a local isomorphism extending £0 and thus com- 
prising ao/60 and a\/b\ and respects 02/62 as well as N(a-i)/N{b2); 

• the second player maintains the local isomorphism condition: the exten- 
sion of £0 by that part of the bijection that covers the region of the new 
pair may serve as the new 

It follows that the second player has a strategy to respond indefinitely, so 
that A =c 3 □ 

Corollary 5.11. The level of equivalence captured by the Sherali-Adams relax- 
ation of fractional graph isomorphism of level k — 1 is strictly between C k ~ 1 - 
equivalence and C k -equivalence, for every k ^ 3. 

5.3 Closing the gap 

As before, we let A, B be graphs with vertex sets [m], [n], respectively, and we 
let A, B be their adjacency matrices. We use variables X p for set p C [m] x [n] 
of size \p\ < k For each 1 j ^ k let J G {0, 1 }M fcx [ nfc ] b e the adjacency matrix 
of the j-th accessibility relation, which relates two A;-tuples if the coincided in 
all but their jth component. We would like to put the extra condition that 
JX = XJ, where we think of the family (Xp)\ p \ = k as one square matrix with 
rows and columns indexed by [m] k and [n] k , respectively. For a particular choice 
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of j, this condition JX = X J translates into 

-^a^b = -^ab^ > 
a ft 

for all a € [m] fe , b € [n] k , a € [to] and b € [re]. For this we just observe that J 
has entries 1 precisely for all tuples aa' and bb' where a' = aj or b' = b| for 
some a € [m] or b € [n]. Note also that J is fully invariant under the action of 
permutations (of [m] or [re]) on the fc-tuples indexing its rows and columns. 

If we look at the indices p as sets of pairs over [m] x [n] again, we want 
to impose the additional requirement of permutation-invariance on the original 
X, which we had thought of as in terms of variables X^ indexed by tuples 
of pairs over [m] x [n]. Let us adopt momentarily the notation p\(j) for the 
result of removing the j-th pair (aj, bj) from p = ab. Then, up to the obvious 
permutation of the resulting tuple, p' = ayby = ab\ (j)^ab. Under the natural 
assumption of permutation invariance, the above can now be re-written into 

^2 X P\(j)~ab = ^2 X p\(jrab, 
a b 

for \p\ = k, a € [rre], b € [n], 1 ^ j ^ k, and hence to the familiar format 

^ ^ Xp^gb ^ ^ -^p^abj 
a b 

for \p\ = k — 1, a 6 [m], b € [n], which is a consequence of Sherali- Adams 
equations Cont(£) of level £ = k (one up!). 

Note that, as is always the case for the continuity equations, these conditions 
make no reference to the edge relations of A and B. 

We now combine the equations Comp(^), concerning compatibility with the 
edge relations, of level £ < k with the continuity equations Cont(^) of levels 
£ k. 



ISO(fc-l/2) 




Xq = 1 and ^ 






> Cont(^) for £ ^ k 


for \p\ < k, a G [n], b € [m] , 




Y^a' Aaa'Xp~ a 'b = Sft' ^■p"ab'^b'b 

for \p\ < k — 1, a € [n], 6 6 [m] 


> COMP(f) for £ < k 


X p > for |p| < A; 





We know from Corollary 15.11 that C fc -equivalence of simple graphs implies 
the existence of a solution for exactly this combination of equations. We now 
want to show that conversely, a solution to ISO (A; — 1/2) yields a strategy for 
the second player in the bijective fc-pebble game, i.e., implies C fc -equivalence. 

First some preparation concerning the solution space of the equations. 
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Lemma 5.12. Let {X p )i p i^ be a solution and f )1 a natural number. Then 
(Xp)\ p \^f, is also a solution where X p is defined by induction on \p\ according to 

Xq := Xtj, = 1 
X p ~ab '■= X p ~ ab = if Xp = 0, 

Xp~ ab := XpdYYtyY))^ ifX p >0 and Y ab := 1/X p X p ~ ab . 

Proof. W.l.o.g. [m] = [n] = [n]. The continuity equations involving the matrix 
X = (X p ~ab)a,fce[n] are preserved under multiplication from the left by arbitrary 
doubly stochastic matrices of the form Z = (Z aa i) aa / e [ n j (just as under multi- 
plication from the right by some doubly stochastic Z' = (Z bb i)). We note that 
Z = YY l = XX t /Xl is doubly stochastic by the given continuity equations 

for X = (X p ~ ab ) a:be [ n ]. It follows that X = (X p - ab ) a)be [ n ] satisfies the new 
continuity equations which stipulate row- and column-sums X p for this matrix. 

For consistency with the view of the X p as being indexed by sets of pairs, 
we need to verify that X p ~ ab = X p whenever ab £ p. But in that case, 
already X p ~ ab = X p was the only non-zero entry in the row of a as well 
as in the column of b, by the given continuity equations. It follows that 
(yy^aa' = Hv X p ~ab'X p ~ a , bl = (l/X p )X p ~ a r b = 6(a',a) so that also 

X p ~ab = X p /X p X p ~ ab = X p as desired. 

Compatibility equations of the form AX = XB are compatible with multi- 
plication of X by Z = XX 1 from the left, whenever A and B are symmetric. 
We note that the adjacency matrices A and B commute with Z = XX t and 
Z' = X l X by the given compatibility equations. 

Passage from X = X p - ab and X p to X p - ab and X p therefore preserves all 
equations of level k — 1/2. □ 

For the following recall the definition of a good matrix without null rows or 
columns from Definition 13.51 

Definition 5.13. Call a solution (X p )\ p ^k a good solution if, whenever X p > 
for \p\ < k, the associated doubly stochastic matrix Y = (l/X p )(X p ~ ab ) atbe [ n \ 
is good in the sense of Definition 13.51 

Corollary 5.14. If there is any solution (X p )i p i^, then there is a good solution. 
For a good solution {X p )i p i^ and \p\ < k with X p ^ 0, let Y be the doubly 
stochastic matrix Y := (^ p ~ a b)a,£>e[n] • Then the symmetric matrices Z = YY l 
and Z' = Y l Y are good symmetric and induce Y '/Y t -related partitions [n] = 
U^Di and [n] = {J^D^, and satisfy 

(i) YDiD' > for all i, and 

(ii) Y DiD'. = for all i^j. 

j 

Proof. An application of Lemma 15.121 with £ ^ n — 1 produces a good solution 
from any given solution. The stated property for doubly stochastic matrices Y 
induced by a good solution follows directly from Corollary 13.91 

□ 



33 



Lemma 5.15. If (^p)u<gfc is a good solution to ISO(/c — 1/2), then for all 
a G [n] k and b e [n] k : 

X ah >0 => „4, a =£ £, b. 

Proof. For /c = 2, we know that even the level 1 equations suffice. We there- 
fore assume that k ^ 3 and fix a good solution (Xp)^^. From the proof of 
Lemma 15.21 (a) we know that X p > implies that p = ab is a local bijection, 
while (b) from Lemma 15.21 tells us that at least every p = ab of size up to k — 1 
with X p > must be a local isomorphism. But for k ^ 3 and simple graphs the 
local isomorphism property for all p of size k — 1 with X p > implies the same 
for p = ab of size k, essentially by monotonicity as imposed by the continuity 
equations: 

Let p = ab, \p\ = k, X p > 0. Then the continuity equations imply that 
X q > for every restriction q C p. E.g., if p = q^ab, then X q = £) , X q - a i b ^ 
X q ~ab = X p shows that X q > 0. But if every size k — 1 restriction of p is a 
local isomorphism, then so is p itself. Here it is important that k ^ 3 is strictly 
larger than the arity of the relations in A and B, the edge relation in this case. 

It remains to argue that the second player has a strategy to maintain the 
condition that X p > in the bijective fc-pebble game on positions p = ab. I.e., 
for a single round played from a position p^ab, where p = ab is of size up to 
jfe-1: 

if X p ~ ab > 0, then there is a bijection p between [m] and [n] 
such that for every pair (a', b') G p, also Xp-aiy > 0. 

Fix p of size up to k — 1 with X p > 0, and let Y be the doubly stochastic 
matrix with entries Y ab := (l/X p )X p - ab . Let Z := YY l and Z' := Y l Y be 
the induced symmetric doubly stochastic matrices with positive entries on the 
diagonal as considered in Lemma [3~8l Let [n] = \J ieI Di and [n] = |J ie7 -Z)- be 
the Y-related partitions of [n] = [m] induced by Z and Z', respectively. Then 
\Di\ = l-D'l for alH E / by Lemma [3 .71 So there is a bijection that is compatible 
with these two partitions in the sense that it associates D{ bijectively to D[. 
Any choice of a pair (a', b') from such a bijection corresponds to an entry Xp~ a <y 
with a! € D-i and b' G D[ for the same i E /; because (X p ) is a good solution, this 
means that the corresponding entry Y a iy is positive, i.e., that X p - a i b i > 0, as 
desired. So, if the second player chooses such a bijection, the resulting position 
p' is guaranteed to have positive X p > again. □ 

The following theorem sums up the results of the previous lemmas and 
should be compared to Theorem 15.71 for ISO(fc — 1). 

Theorem 5.16. ISO(A; — 1/2) has a solution if, and only if, A =q B. 
5.4 Boolean arithmetic and L fc -equivalence 

We saw in Section 14.21 that equations, which are direct consequences of the 
basic continuity and compatibility equations w.r.t. the adjacency matrices A 
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and B, may carry independent weight in their boolean interpretation. This is 
no surprise, because the boolean reading is much weaker, especially due to the 
absorptive nature of V, which unlike + does not allow for inversion. AX = XB 
for doubly stochastic X and A, B G M n,n implies A C X = XB C . Similarly, we 
found in part (a) of Lemma 15.21 that the continuity equations imply that p is 
a local bijection whenever X p > 0, under real arithmetic; this also fails for 
boolean arithmetic. 

We now augment the boolean requirements by corresponding boolean equa- 
tions that express 

(a) compatibility also w.r.t. A c and B c , as in boolean fractional isomorphism, 

(b) the new constraint X p = whenever p is not a local bijection. 

In the presence of the continuity equations, which force monotonicity, it 
suffices for (b) to force X^'by = f° r all a, a' G [m], b, b' G [n] such that not a = 
a' 44> b = b' . This is captured by the constraint Match(2) below. Together 
with the continuity and compatibility equations, Match(2) then implies that 
X p = unless p is a local isomorphism, just as in the proof of part (b) of 
Lemma 15.2} also in terms of boolean arithmetic. 

So we now use the following boolean version of the Sherali-Adams hierarchy 
ISO(k - 1) and ISO(fc - 1/2) for k>2. 



B-ISO(fc-l) 






Xq = 1 and 


1 




Xp = J2b' X p ~ab' = Yla' ^P' 




> Cont(£) for t < k 


for \p\ < k,a G [m], b G [n] 






X a b~ab' = = X ab ~ a i b 

for o/o'e [m],b ^ b' G [n 




> Match(2) 


Y2a' A a a'Xp~ a 'b — Y^b> X p ~ a b>Bb>b 

for \p < k — 1, a G [m], b G [n] 


> Comp(£) for £ < k 


Sa' A c aa iX p ~ a i b — J2b> Xp~ a 
for \p\ < k — 1, a G [m], b G 


b' B b'b 
[n] 


> Comp(^) c for £ < k 



For B-ISO(/c - 1/2) we just require Cont(£) for all £ ^ k, i.e., additionally 
for £ = k. 



Remark 5.17. B-ISO(fc — 1) and B-ISO(A: — 1/2) are systems of boolean equa- 
tions, and the reader may wonder whether they can be solved efficiently. At first 
sight, it may seem NP -complete to solve such systems (just like boolean satis- 
fiability). However, our systems consist of "linear" equations of the following 
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forms: 



£^ = E^ (13) 

iei jeJ 
iei 

E^ = L ( 15 ) 

iei 

( The equations of the form (|14p are actually subsumed by those of the form (I13p 
with J = %.) It is an easy exercise to prove that such systems of linear boolean 
equations can be solved in polynomial time. 



The weak /c-pebble game is the straightforward adaptation of the weak bi- 
jective /c-pebble game to the setting without counting. A single round of the 
game is played as follows. 

1. If \p\ = k — 1, player I selects a pair ab £ p. If \p\ < k — 1, he omits this 
step. 

2. Player I chooses an element a' of A or b' of B. 

3. Player II answers with an element b' of B or a' of A, respectively. 

4. If p + := p^a'b' is a local isomorphism then the new position is 

f {p\abya'b' if|p| = fc-l, 
p := { 

y p^a'b' if \p\ < k - 1. 

Otherwise, the play ends and player II loses. 

We denote weak /c-pebble equivalence as in A =^ k B and extend this to 
A, a =l k B, b for tuples a, b of the same length < k. We sketch a proof of 
the following, which is a boolean analogue of the correspondences between half- 
step levels of Sherali-Adams and C k - and C <fc -equivalence established in the 
last section. 

Theorem 5.18. (a) B-ISO(/c — 1) has a solution (w.r.t. boolean arithmetic) 
if and only if A =^ k B. 
(b) B-ISO(/c — 1/2) has a solution (w.r.t. boolean arithmetic) if and only if, 
A =l B. 

Proof. We start with the second part of the theorem. For the backward direc- 
tion, suppose that A = k B and let, for p = ab of size \p\ ^ k, 

x r i nA, a = k L B,b, 

P ' \ else. 

Clearly this assignment satisfies Match(2), and one easily checks that it also 
satisfies the boolean continuity equations Cont(£) for I ^ k. For the boolean 
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compatibility equations Comp(^) and Comp(^) c for £ < k, let us check, for 
instance, an equation Comp(/c — 1). The non-trivial case is that of p = ab 
where a G [n] fc ~ 2 and b G [m] k ~ 2 are such that A, a B,h so that X p = 1. 
Consider the instance of equation Cont(/c — 1) for a £ [m], 6 G [n]: 

/^A aa iX p ~ a f b = ^ X p ~ ab iB b / b . 

a' b> 

Since .A, a =£ B, b, there is a 6 G [m] such that A, aa =£ 0, b6. Suppose the 
left-hand side of the equation evaluates to 1. This means that there is an edge 
in A from a to some a' for which X p ~ a / b = 1, i.e., for which A, aa' =^ B, hb. 

In other words, there is an edge in A from some a' for which A, aa' =^ £>, hb 
to some a for which A, aa = £>, hb. So every realisation of the L fc -type of B, hb 
has an edge between b and some 6' where £>, hb' =f A, aa, which implies that 
the right-hand side of the equation evaluates to 1, too. 

For the forward direction, we extract from a good solution to ISO(fc — 1/2) 
a strategy for the second player to maintain pebbles in configurations ab for 
which X a b = 1. Let p = ab of size \p\ < k be such that the current position 
is p ^ab, where X p ~ ab = 1, and let the first player move the pebble from a 
to a' in A, say. The second player needs to find some b' in B such that again 

Xp~ a 'b> = 1- 

Analogous to the real good solution is one where all the matrices 

Y ab = X p ~ ab for X p y£ (which are necessarily without null rows or columns), 
are such that the ^-related partitions of [n] and [m] induced by Z = YY l 
and Z' = Y l Y put a and b in related partition sets if, and only if, Y ab = 
1. Here again, it suffices to postulate that Z and Z' are good symmetric, 
and an arbitrary solution can be turned into a good solution on the basis of 
Lemma 13.101 

So, if the second player picks any b' G [m] for which Y a iy = 1, this makes 
sure that X p - a i b i = 1 is maintained, and that p ^a'b' is a local isomorphism. 

We turn to part (a) of the theorem. 

For the forward direction, we want to extract from a good (!) solution a 
strategy for the player II in the weak fc-pebble game that maintains positions 
p s.t. Xp = 1. Recall that positions are now of size < k. Consider a position 
p = aahb of size \p\ = k — 1 with X p = 1. Suppose that player I selects ab 
in the first step of the next round ("he announces to withdraw the pebble pair 
on ab") and selects a' in the second step ("he places a pebble on a'"). W.l.o.g. 
suppose that a' ^ a, because a' = a has the obvious response b' := b. Player 
II needs to find some b' G [m] such that p + = p^a'b' is a local isomorphism 
and for p' = (p\ ab)^ab also X p i = 1. It suffices to make sure that X p / = 1, 
that 6' ^ b, and that 66' is an edge in B iff aa' is an edge in A. Suppose, for 
instance, that aa' is not an edge, i.e., that A aa > = 0. 

Let p~ = p\ab, and let Y be the matrix with entries Y a n b n = X p -~ a »yi. Let 
[m] = (L-Dj and [n] = IL-C^ the partitions induced by YY l and Y l Y , which 
are boolean bi-stable for A and B, respectively, and Y-related. Suppose a G Dj 
and a' G Dj, so that A aa i = implies that if? = 1. Since Y ab = 1, we have 
6 G D\\ and as if^ = if^ = 1, there is also some 6' G D'- for which B^ b , = 1, 
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so that bb' is a not an edge in B and b' ^ b. As we are dealing with a good 
solution, a' £ Dj and 6' G D' imply that Y a 'b' = 1, so that X p > = X p ~~ a , b , = 1. 

For the backward direction, suppose that A =<& B and let X$ := 1 and, 
for a G [n] fc_1 and b G [m] k ~ 1 , X ah := 1 iff A, a =< fe 0,b. It is clear that 
this assignment satisfies Match(2) and Cont(£) for I < k. Consider then an 
instance of Comp(^) for i < k, 

y^jAgaiXp-gib = y^^X p ~ ab /B b / b , (16) 

a' b' 

where a G [n],b G [m], \p\ < k — 1, p = ah. Let us assume that \p\ = k — 2; 
this is the most difficult case. If X p = then X p ~ a i b / = for all a'b', and thus 
equation (fT6j) is trivially satisfied. So assume X p = 1, that is, A, a =^ k B,h. 
Suppose for instance that the left-hand side of equation ([TBI) evaluates to 1, i.e., 
that there is some a' adjacent to a in A for which A, aa' =^ k B, hb. Consider 
the weak A:-pebble game in position aa'bfr. Assume player I selects the pair 
a'b in the first step of the next round and selects a in the second step. Let b' 
be the answer of II when she plays according to her winning strategy. Then 
aa'a i— >■ hbb' is a local isomorphism and the new position aab&' is a winning 
position for player II, that is, A, aa =f k B, hb'. Since aa'a i-4 hbb' is a local 
isomorphism and aa' is an edge of A, the pair bb' is an edge of B and thus 
B b i b = 1. Since A, aa =^ k B,hb', we have X p ~ ab i = 1. Thus the right-hand side 
of equation (I16p evaluates to 1 as well. □ 

Remark 5.19. For all k ^ 3, =j_ - 1 J =^ k , =\_ form a strictly increasing hier- 
archy of discriminating power. 

Proof. The examples for the gaps between =^ _1 , =£ k , gi ven i n Section [oT2l 
are in fact good in the setting without counting. The strategy analysis given 
there does not involve counting in any non-trivial manner. □ 
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